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We extend the Markov additive methodology developed in [Ann. 
Appl. Probab. 9 (1999) 110-145, Ann. Appl. Probab. 11 (2001) 596- 
607] to obtain the sharp asymptotics of the steady state probability 
of a queueing network when one of the nodes gets large. We focus 
on a new phenomenon we call a bridge. The bridge cases occur when 
the Markovian part of the twisted Markov additive process is one 
null recurrent or one transient, while the jitter cases treated in [Ann. 
Appl. Probab. 9 (1999) 110-145, Ann. Appl. Probab. 11 (2001) 596- 
607] occur when the Markovian part is (one) positive recurrent. The 
asymptotics of the steady state is an exponential times a polynomial 
term in the bridge case, but is purely exponential in the jitter case. 

We apply this theory to a modihed, stable, two node Jackson net¬ 
work where server two helps server one when server two is idle. We 
derive the sharp asymptotics of the steady state distribution of the 
number of customers queued at each node as the number of customers 
queued at the server one grows large. In so doing we get an intuitive 
understanding of the companion paper [Ann. Appl. Probab. 15 (2005) 
519-541] which gives a large deviation analysis of this problem using 
the flat boundary theory in the book by Shwartz and Weiss. Un¬ 
like the (unsealed) large deviation path of a Jackson network which 
jitters along the boundary, the unsealed large deviation path of the 
modified network tries to avoid the boundary where server two helps 
server one (and forms a bridge). In the fluid limit this bridge does 
collapse to a straight line, but the proportion of time spent on the 
flat boundary tends to zero. 

This bridge phenomenon is ubiquitous. We also treated the bath¬ 
room problem described in the Shwartz and Weiss book and found 
the bridge case is present. Here we derive the sharp asymptotics of the 
steady state of the bridge case and we obtain the results consistent 
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with those obtained in [SIAM J. Appl. Math. (1984) 44 1041 1053] 
using complex variable methods. 

1. Introduction. In Section 2 we analyze the spectral radius of the Feynman- 
Kac transform of a Markov additive process. In Section 5 we develop a ratio 
limit theorem for Markov additive processes. In Section 6 we use these results 
to extend the method in [8, 14] to a general theory for the sharp asymptotics 
of the steady state probability it of queueing networks when the queue at 
one node gets large. Finally, in Section 7 we apply these general results to 
obtain the asymptotics of Tr(£,y), the steady state of a two node modified 
Jackson network, as l —> oo. 

A two node Jackson queueing network is described in the companion paper 
[9] which we refer to as Part I. The servers at node two, when idle, can assist 
the server at node one. Allowing one of the servers to help can completely 
change the behavior of the network. Clearly, a large deviation where the first 
node gets large tends to avoid emptying the second node because the idle 
node will help the overloaded node and make the large deviation less likely. 

The large deviation path to a point where the queue at node one is of size £ 
and the queue at node two is empty or of fixed size will tend to be a bridge. 
Asymptotically the large deviation path spends no time at states where the 
second queue is idle, as was seen in Part I. 

This paper explains the dichotomy between the positive recurrent (jitter 
case) when the idle node does not help much and the large deviation path 
jitters along the axis where the second queue is idle and the transient or 
null recurrent (bridge case) when the idle node helps a lot giving rise to the 
bridge behavior. The former gives an exponential decay of n(£,y) as £ —> oo, 
while the latter has an additional polynomial factor. 

The bridge phenomenon is ubiquitous. In Section 8 we use this theory 
to revisit the bathroom problem discussed in [6, 14, 22], Depending on the 
parameters, we obtain the jitter case discussed in [14] or a bridge case. In 
Section 8 we work out the asymptotics of the bridge case and we find exactly 
the same asymptotics of the steady state probability as was obtained in [6] 
using complex variable methods. 

There are several approaches to obtaining the sharp asymptotics of the 
steady state probability of a queueing network. The oldest is the exact so¬ 
lution in product form when the network is quasi-reversible. The book by 
Serfozo [21] gives the state of the art. These product form solutions are 
a minor miracle, but they are very fragile as the slightest change in net¬ 
work dynamics can destroy the product form. The compensation method 
developed by Adan [1] is a generalization where one represents the steady 
state probability as an infinite linear combination of product measures. This 
method does allow one to attack nonproduct form steady states, but it is 
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essentially a two-dimensional theory. It is hard to derive the asymptotics 
of the steady state and this is generally the most useful quantity. It is also 
hard to see how this theory could handle bridges where the steady state 
probability decays like a polynomial times an exponential. 

The complex variable method used in [6] reduces the functional equation 
satisfied by the two-dimensional ^-transform of the steady state probability 
to a Riemann Hilbert boundary value problem. One obtains a representa¬ 
tion for the z-transform, which, in principle, determines the steady state, 
but again it is essentially a two-dimensional theory and it can be hard to 
derive useful quantities like the asymptotic behavior of the steady state 
probabilities. We were unable to derive the asymptotics of the solution of 
the coupled processors model (a special case of our modified Jackson net¬ 
work) obtained by complex variable methods in [4]. Fortunately for us, [6] 
does provide asymptotics and they agree with ours! 

Finally, the matrix geometric method [16] has been recently extended 
in [23] to obtain the asymptotics of quasi birth and death QBD processes 
with infinite phase. In fact, these processes are Markov additive and closer 
inspection reveals a close parallel with the results in [8] and [14]. We discuss 
this parallel in Section 8. 

In future work we will investigate the sharp asymptotics of the mean time 
until the queue at one node of the modified Jackson network overloads, as 
well as the Yaglom limit of the distribution of the queue at the second node. 

2. Markov additive processes and the Feynman Kac transform. In this 
section we define the Feynmac-Kac transform J 7 of the transition kernel 
J of a Markov additive process. The Markovian part of J 7 will be denoted 
by J 7 . Lemma 1 gives a representation of the spectral radius of J 7 and a 
condition for determining whether J 7 is -R-recurrent or R-transient, where 
1/-R is the spectral radius of J 7 . 

Let (V, Z) = (V[n], Z[n]),n = 0,1,2,..., be a Markov additive process 
(see [17]) on a countable state space Z x S, where Z = {..., —1,0,1,... }. 
Given any state x, we denote the first component by x\ and the second 
component by x E S. The process ( V , Z) is a Markov chain with the follow¬ 
ing additional structure: 

Pr{(F[n + 1], Z[n + 1]) = x\(V[n], Z[n}) = z} 

= J(z, x) 

= J((z i,z),(xi,x)) 

= J((0,i),(xi -Z!,x)), 

where J denotes the transition kernel of (V,Z). Note that the marginal 
process Z forms a Markov chain with state space S. We assume that Z is 
irreducible, and we let J denote the transition kernel of Z. 
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As in [17], let J 7 denote the Feynman-Kac transform of J. That is, for 
any real 7 , 

(1) J' Y {{xi,x),{y 1 ,y)) = e l{yi ~ xl) J((x 1 ,x),(y 1 ,y)). 

Let J 7 be the Markovian part of J 7 , that is, 

( 2 ) Jy{x,y) = ^ J 7 (( 0 , £),(?;,£)). 


Since J is irreducible, we know that J 7 is irreducible. We assume J 7 (x,y) < 
00 for all x,y E S. Let r(J 7 ) be the spectral radius of J 7 and let i?(J 7 ) = 
l/r(J 7 ) be the associated convergence parameter. By Lemma 2 in [10], 
A(y) = log(r(J 7 )) is a closed convex proper function [and so is r(J 7 )]. As an 
aside, the next paragraph gives a short proof that A(y) is a convex function 
of 7 . 

First, for every y, A n (y) := (J™(y,y)) 1 / n —> r(J 7 ). Next, for any n, we 
verify the function log(A n ( 7 )) is convex in 7 by checking that the second 
derivative is nonnegative. The second derivative is A'^/A n — (A' n ) 2 /A^. By 
calculation, 


(KY 1 /y 

n 2 1 < ^ 


n \ v J~(y, y) 


J”((°,y),(u,y)) 


and 




V ^7 




- £ 


n ' \v J2(y,y) 


J 7 ((0,y),(u,y)) 


Hence, 






„ Jy(y,y) 

1 


J 7 ((0,y),(u,y)) 




1 ? ^7 


Jj(y,y) 


The quantity in brackets above is equal to the variance of the measure 
J™((0, y), (•, y))/J™(y, y), which must be nonnegative. Since a limit of convex 
functions is convex, it follows that A ( 7 ) is a convex function of 7 [and so is 
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Let 

fj(y,y)= £ Myii/WMyWM ) x ••• 

y[\]^y,...,y[n-\]j=y,y[n\my 

x J'y(y[n-2],y[n- l])J 7 (y[n- 1 ],y[n]) 


and define the transform ^( 7 , it) = / 7 ($> y) un ■ Note that T( 7 ,e -1 ’) = 

if( 7 ,C)j defined at (3.2) in [17]. In [17], it is shown that if the set W = 
{( 7 ) C)i ^( 7 ) 0 < °°} is open and if there exists a A( 7 ) < 00 such that 7 , A( 7 )) 
1, then A( 7 ) = e A ( 7 ^ is an eigenvalue of J 7 and J 7 is e _A i 7 i-recurrent. We 
will need a little more since we are also interested in the e _A ( 7 )-transient 
case. 


Lemma 1 . We have i?(J 7 ) = sup{u: Hi(7,11) < 1 }. Also, J 7 is R(J 7 )- 
recurrent if and only if ^( 7 , R( J 7 )) = 1. 


Proof. Note that 4 /( 7 , it) is strictly increasing in u. Both results follow 
from 


(3) 


£ J m m V), (x, y))e' yx u m = £ J 7 m ((0, y), (x, y))u m = 


1 


1 — ^(7 ,u) □ 


3. Asymptotics of Gq((Q, 0); (l, 0)) when X is a nearest neighbour walk. 

In Theorem 4, we give the asymptotics as t —► 00 of the steady state it(£, y) 
of a Markov chain in terms of the asymptotics of &),(£, a)), where Q 
is the potential of the associated twisted (boundary-free) Markov additive 
chain and a is some fixed state. In general, it may be impossible to obtain 
these asymptotics, but in this section, we determine exact asymptotics of 
the potential for a Markov additive chain with a particular structure. We 
denote the transition kernel of this particular Markov chain by X and its 
potential matrix by Qq := J2^=o-^ n - Throughout, we use the subscript 0 to 
emphasize that this process may be killed when the Markovian part hits the 
fixed state <7 = 0. 

Let (Vo,X 0 ) be a Markov additive process with transition kernel X. We 
will assume that X is the transition kernel of a two-dimensional random 
walk when the Markovian component is positive and that the Markovian 
component is a nearest neighbor random walk on 5 = {0,1,2 ,...} with a 
killing probability k > 0 when the Markovian part is zero. 

More precisely, we assume for X, 


Z((0,y),(x,y + z))=I({0,l),(x,l + z)) for y>0 
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and for X, 


i{y,y + 1) 
i(y,y) 
i{y,y- 1) 


p, 

for y > 0 , 

Po, 

for y = 0 , 

S, 

for y > 0 , 

So, 

for y = 0 , 

q, 

for y > 0 , 

0 , 

for y = 0 


with p > 0 , q>0, p + q + s=l, po>0 and n = 1 — po — So > 0 , where k is 
the probability that the process is killed when the Markovian part is zero. 

To complete the specification of X, assume that we are given the following 
transforms: 


p ( z ) = J2 T (( 0 ’y^( x ’y + l )) zX > 

X 

s ( z ) = ^Z T { < s ) ,y),{ x ,y)) zX , 

x 

(4) Q( z ) = X]X((0,y), (x,y — ]))z x for y > 0, 

X 

P 0 (z) = J2 p (M,(x,l))z x , 

X 

= ^X((0,0),(x,0))X E for y = 0, 

X 

which are assumed to be finite in some neighborhood of 1. The first three 
transforms describe the behavior above, and the last two on the axis. Note 
that -P(l) = p, 5(1) = s, Q( 1 ) = q, Xb(l) = Po, 5o(l) = s o and that the hori¬ 
zontal drift above the x-axis is given by 

(5) d + = (P'(l) + Q'(l) + S'(l)). 

Also note that the five functions P(z), Q(z), S(z), Pq(z) and Sq(z) are 
analytic in some annulus D r,R , where D r,R = {z£ C|r < \z\ < X?}, C is the 
complex plane, r < 1 < R, and the right-hand sides form the Laurent series 
representations of the functions on the annulus D r,R . 

We will be particularly interested when X is either 1-transient and 1-null 
recurrent, which corresponds to the bridge case. Under these conditions, 
Proposition 1 gives the exact asymptotics of Uo((0,0); (£, 0)), which is simply 
the expected number of visits to some distant point (£, 0 ) given that (Vo, Zq) 
started at the origin. 

Recall that a discrete (substochastic) density h on the integers has pe¬ 
riod r > 1 if r = gcd{u : h(u) > 0 }, where gcd denotes the greatest com¬ 
mon divisor of the set. Equivalently, r is the largest integer such that the 
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support of h is contained in the set {kr, where k€ Z}. We will say that 
H(z) = h(x)z x has period r if h has period r. If H has period r, 

then H(exp(2kni/r)) = H( 1) for all integers k, but |iL(-)| is strictly less 
than H( 1) on the rest of the unit circle. 


Proposition 1. Ifp = q, then the spectral radius oft is one. In addi¬ 
tion, suppose that d + > 0 and that the following aperiodicity condition holds. 
If s > 0, the period ru+D of the transform P(z)Q{z)/(jpq) and the period rs 
of the transform S(z)/s must he relatively prime; otherwise, if s = 0 , then 
rjj .(_£> must be one. Under these three conditions, 


f?o(( 0 , 0 ); (£, 0 )) := ^ T™(( 0 , 0 ); (£, 0 )) 

n=0 


C+i 3//2 , for k > 0 , 

CqI~ 1/2 , for k = 0, 


where 


C 4 


Po j d+ 

K 2 y 27 t(1 — s) 


and Cq 



Before proving Proposition 1, we derive some expressions that will be used 
in the proof (and hold without the proposition’s hypotheses). Roughly, our 
approach is to derive the generating function Go(z) = X)«>o^o((0, 0 ); (re, 0))^” 
and then extract the coefficients asymptotically. The generating function 
Qo(z) can be written as 1/(1 — F(z)), where F(z) = E ( 0 0 )[z v °M] and r > 0 
is the number of steps until the Markov chain Zq returns to zero. Note that 
-F(l) = 1 — k. Rather than deriving F(z) directly, we derive E( 0 ,o)[' l£r " Vo ^]) 
which slightly generalizes results in Section 6 of [20]. 

Temporarily, assume s > 0 and s o > 0. Let U be the number of upward 
steps taken by time r, and let f n = P(U = re). Hence, /o = so and 

( 6 ) E( 0 ] 0 ) [re T 2; Vo[Tl |£7 = 0] =uS 0 (z)/s 0 . 


To calculate f n when re > 0, note that the first step must be up, which has 
probability p o- If we ignore all steps where Zq stays put, then the probability 
of an upward step is p/(p + q), while the probability of a downward step is 
q/{p + q). The total number of paths is c n _i, the (re — l)st Catalan number; 
that is, c n is the number of paths of 2 re steps on the positive y-axis that 
start and end at the origin and contain only nearest neighbor steps. Hence, 


fn — Cn—lP0 



—) 

p + qj 


i 2 ti 

It is well known that Cn = —tt(^ ) and that the series c n -\u n = (1 — 

\/l — 4re)/2 with a radius of convergence The square root is defined using 
a branch cut along the negative real axis. 
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Given U = n > 0, the first step must be up, but after that there are 
2n — 1 different places where Zq can stay put for a geometric number of 
transitions. Hence, t = 2n + E^, where E are independent geometric 

random variables with law P{Ek = m) = s m (l — s), m = 0,1,_Each Ek 

represents the number of times Zq stays put between jumps. The transform 
of the associated displacement when Zq stays put is S(z)/s. If we let X[k\ 
be the additive displacement during the kth transition when Zq stays put, 


_ p °o / 

E[u Ek z^k=i x W} = s m (l - s)u m ( 
m =0 ' 


S(z) 


1 — s 


1 — uS(z) ’ 


provided |rtS'(^)| < 1. Hence, 

E ( o,o) [u T z Vo ^\U = n > 0] 

_Po(z)fP(z)\ n ~ 1 fQ(z)\ n 2n ( 1-s ' 2 "“ 1 


(7) 

_ 1 

Po V P J V q J Vl -uS{z) 

assuming |u5(z)| < 1. 

It follows that if |w5(z)| < 1, 

e (0i0) k^M] 

, S 0 (z) ™ P 0 (z)fP(z)Y- 1 fQ(z)Y 2n f 1-s 

= JOU - r ) ^Jn 


SO 


n =1 


Po V P 


\ q 


1 — uS(z ) 


= uSq(z) + Y c n-lP0 


n =1 


p 


n —1 


q 


p + qj \p + q 

n —1 


Pq{z)(P{z)Y-^(Q{z)Y 2n 
Po V P / V 9 


1 — s 


1 — uS(z) 


2n—l 


= uSq(z) + 


1 — uS(z) p + q p 


1 — s 


OO 

X ^' Cn—l 
n= 1 


p P(z) 
P{z) Q{z ) 

p+qp+q 


PoW 


,2 n 


1 — 5 
1 — uS(z ) 


2n 


( 8 ) 


\ 1 - uS(z) p + q ^ . . 

uSo (z) + - r Y TW) PoO) 


l-i1-4 


1 — s 


-PQ) Q(z) 

p + qp + q Vl —uS(z) 


where the last summation required the term inside the square root be posi¬ 
tive. Note that the last three expressions also hold when s = 0 or sq = 0 so 
we can resume assuming that s > 0 and sq > 0. 
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Before using (8) to compute F(z), we will use it to compute the radius of 
convergence of E( 0i o)[^ T ]) which will be used in the proof of Proposition 1. 
Let z = 1 in (8), and notice that E( 0 ,o) [ y +] exists iff 

(9) |us| < 1 


and 

( 10 ) 

in which case 


P 


Q 2 

-u 


p + qp + q V1 — us 


1 — s 


~ 4’ 


( 11 ) 


E( 0 , 0 ) [^ T ] — s 0 u + 


(1 — us) p + q 


- S 


p 


-p 0 


1 — 1/1-4- 


P 


9 2 

-ir 


p+qp+q 


1 — s 
1 — us 


It is easy to see there exists positive u <1/s such that (10) is not satisfied. 
Since E( 0t0 )[u T ] is an increasing function of u, there is a unique, positive 
R < 1/s such that 


( 12 ) 


P 


q 


p+qp+q 


-R 2 


1 — s 
1 — Rs 


4’ 


and R must be the radius of convergence of the power series in u given by 

E (0 ,o) lyr 

To obtain F(z), let u = 1 in (8), which gives 


F(z) = Sq(z) + 


(13) 


(14) 


1 - S(z) p + q Pp{z) 
1-8 P{z) 2 


x 1 -,1-4 


P{z) Q(z) 


1 — s 


p + qp + q\l - S(z) 
= A(z) - B(z)sjc\z)\/1 - z, 


A(z) = S Q {z) + B(z), 


B{z) 

C(z) 


1 ~ S(z) p + q P 0 (z) 

1 — s P{z) 2 ’ 

1 / ^ P{z) Q(z) ( 1 - a \ 2 \ 

l-A p + qp + q \i- S(z)J ) 


where 
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For future reference, note that 


E (0,J/) 


[ 2 VoM] 


1 - S(z)p + q 1 
1 - s P(z ) 2 


(15) 


1-i1-4 


P(z) Q{z) / 1-s 
p + qp + q\l - S(z) 


v 


for y = 1,2,..., 

which can be obtained by using (13), F(z) = Sq(z) + Po(^)E(o,i)[" Vo ^] and 

e (o i 2 / )[^M]= e ( 0 > i)[^M]^ 

We will use the following lemma in the proof of Proposition 1. 


Lemma 2. If p = q, d+ > 0, and the aperiodicity condition given in 
Proposition 1 holds, then y/C(z) is analytic in an annulus D r,R , where 
r <1 < R. 


Proof. First, we show that y/C(z) is analytic for z G D r,R \ { 1 }. On 
the contrary, suppose y/C(z) has a singularity on the unit circle at zo / 1. 
This means 


(16) 


{ P{zq) Q(zq) f 1 -s \ 2 = 1 

p + q p + q VI - S(z 0 )J 


Since |P(zo)| <Pi |Q(-o) < q and |1 - 5(2 0 )| 2 > (1 — ^(^o)!) 2 > (1 — s) 2 , the 
only way that (16) can hold is if |P(zo)| = P, |<3(2o)| = q and |1 — 5(^o)| = 1 — 
s. The last equality holds only if 5(^o) = s. Moreover, P(zo)Q(zo) / (pq) = 1, 
which means that P(z)Q(z)/(pq) must be periodic with a period ru+D > 1 
since zq^I. Similarly, if s > 0, then S(z)/s must be periodic with a period 
r s > 1. 

Suppose that s > 0. By the periodicity of S(z)/s, there exists a positive 
integer ks < rs so that 6 = 2n^ and zq = exp(0z). Similarly, there exists a 

positive kjj+D < r u+D so that 9 = 2ir . Thus, 


ks_ _ ku+p 
rs r u+D 


/<!■ 


As a consequence of Euclid’s algorithm, there are integers ms, mu+D such 
that ms ■ rs + mu+D ■ = qcd{rs,ru+D} = 1, where the last equality 

follows from rs and ru + £> being relatively prime. However, this means ms • 
ks + mjj+D x ku+D = /) which is a contradiction since the left-hand side is an 
integer, but 0</<l.Ifs = 0, then we come to the same conclusion because 
ru + D has period one by hypothesis. Hence, y/C(z) is free of singularities on 
z G D r ' R \ {1}; to complete the proof, we need only show that y/C(z) is also 
analytic at z = I. 
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By l’Hopital’s rule, 


lim C(z) = 4 

Z —>1 

= 2 


^(1) q | p Q'( 1) | 
p+qp+q p+qp+q 

P\ 1) , Q\ 1) , S\l) \ 
p + q p + q (1 — s)J 


p q 
p+qp+q 



since p = q 


(17) =2d+/(l-a). 


By hypothesis, d_|_ > 0 so the limit exists as z —> 1 and is in the domain of 
the square root. Hence, it follows that y / C'(z) is analytic in some annulus 
D r,R . □ 


Proof of Proposition 1. Since p = q, R= 1 satisfies (12) and obvi¬ 
ously R < 1/s. So the radius of convergence of E( 0j o)(ti r ) is 1, as desired. 
Note also that by (11), E( 0j o)(l T ) = Pr (r < oo} = so + po = 1 — k, 

OO 

Go(z) = ^o((0,0); (n, 0 ))z n = — r— 

n=0 

= (1 - A(z) + B(z)yjC\z)Vl^z)~ l 

1 — A(z) — B(z)yJC(z )\/1 — z 
= (l-A(z)) 2 -B 2 (z)C(z)(l-z) 

l \ i r2 ( z ) fn7~\ B - 

= r{z) + —rT + C(z)Vl - z, 
r 0 {z) v 

where 

r 0 (z) = (1 - A{z)f - B 2 (z)C(z)( 1 - z), 
n{z) = 1- A(z), r 2 (z) = -B(z), r(z) = 

w) 

So(z), Po(z), S(z ), P(z), Q(z) are analytic in some annulus D r,R as is 
+'C(z) by Lemma 2. Furthermore, 

r „ (2) - (i - * w - b { z+ - b\*) (i - mm (_i_f_ 

- (1 - - 2BW(1 - «><*» + 4B2(z) y^yw(ws&)) 2 

=a - s 0 iz)f - im ++± Po{z){ i _ sow 

1 — S P{Z) 

1 1 -S(z)p + q \ 2 P(z)Q(z) ( 1-s \ 2 
2 1-s P(z) J p + qp+q\l-S(z)J 
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= (1-So0)) 2 


1 -S(z)p + q 
1 — s P(z) 


P 0 (z)(l-S 0 (z)) + P 0 (z) 2 


Q(z) 

P(z) 


_ D(z) 

- P(z) ’ 

where D(z) = P(z)(l-S 0 (z)) 2 - (p + q)P 0 (z)(l- S 0 (z)) + P 0 (z) 2 Q(z). 

Since 


P ( z )f, Cf\ 1 f 1 - S ( Z )\P + ( 1 r, i \\ 

rW = wn So(2) -2{~Tz^)m oi ) )' 

it follows that r(z) = r 5 (z)/D(z), where r%{z) is analytic on D r,R . Similarly, 


r 2 (z) P(z) f 1 fl - S(z)\p + q 


ro(z) D{z) 


1 — s 


P( Z ] 


-M z ) 


so r 2 (z)/ro(z) =r±(z)/D{z), where r±(z) is analytic on D 


r,R 


Case 1. Assume k > 0. Note that D(z ) has no zeroes in {r < \z\ < 1}, 
where r < 1. Suppose it did! It would follow from the above that 1/(1 — F(z)) 
would have a pole inside {r < \z\ < 1}. This is impossible because F( 1) < 1 
[so |.F(z)| < 1 if \z\ < 1] when the killing probability k is greater than zero. 
Since D(z) only has a finite number of zeroes in a compact set, it follows that 
there exists an annulus D t,Rd with Rp > 1 > r, where 1 /D(z) is analytic. 
Hence, 

Go((0,0);(£,0))= / ^ dz , 

J -y Z 

where 7 is any positively oriented circle that encloses zero inside the domain 
of convergence of Go(z). Since r(z) is analytic on the punctured disk of radius 
Rd > 1 , 


r(z) 

~£+i 


dz = 


( z ) 


v+ Z 


£+1 


dz —» 0 


exponentially fast, 


where 7 + is a circle of radius greater than one. Consequently, the coefficient 
of z^ in the Laurent expansion of r(z) decays exponentially fast as £ —> 00 
and can be neglected. 

Moreover, 


^\/c(i\/(l-*) = - c /( 1-2) + 0(11 - 2 |) 

as 2 —► 1 in D at s, where D a ^ = {z G C: \z\ < 1 + <5, | arg(z — 1 )| > a}, where 
5 > 0, 1 + <5 < i?, 0 < a < 7 t /2 and where 


C 


-y/C(l)r 2 {l)/r 0 (l) 


Po j 2d+ _ Po j 2 d + 

{l-p 0 -s 0 ) 2 \l 1-s n 2 \jl-s' 
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If 1 + 5 < R d , then \fC[z) = j^\/C(z) is analytic in D a j. By Theo¬ 
rem 16.8 in [24], 

So((0,0);(^0))~-c( f '~/ /2 ) 


= -CT[l + 1 - 3/2]/(F[£ + 1]T[1 - 3/2]) 
~-CT[£- l/2]/(T[£ + l]T[-l/2]). 

Recall \Jtx = T[1/2] = (— l/ 2 )r[— 1/2] and the fact that F[l — 1/2 }/F[£ + 1] ~ 
•£~ 3 / 2 as >-oo (see (5.02) in [19]). This gives 


So((0,0);(^0))~-^r 3 / 2 

2y 7r 


Po I d + - p-3/2 
K 2 V 27r(l — s) 


Case 2. Assume «; = 0. Note that in this null recurrent case, D( 1) = 0. 
Calculation shows D'(l) = pQd + which is positive by hypothesis so r 2 (z)/r$(z) 
has a simple pole at z = 1. Consequently, the expansion of 7*2 (z)/ i~o(z) around 
1 to first order is 

P ( 1 { l ~S(l) \ p + q l-a 

p%d+(z- 1 ) V 2 V 1 — s / p ° ) 2 pod + (z — 1 ) ’ 

To show that r(z) is again negligible, note that tt(1) = 0, which cancels the 
zero of order one in D(z) at z = l. Hence, r(z) is analytic at l so this term 
may be neglected as in the previous case. Therefore, in the neighborhood of 
1, 

where c = (1 — s)/(poy/2d + ). 

Again by Theorem 16.8 in [24], 


0o((O,O);(£,O))~c(* / /2 ) 

~cr[£ + i/2]/(r[^ + i]r[i/2]). 

Recall s/tt = T[ 1/2] and the fact that F[£ + 1/2 ]/F[£ + 1] ~ £~ 1 / 2 as l —> 00 
(see (5.02) in [19]). This gives 


{?o((0,0); (£, 0)) ~ ~^j=£~ l/2 
\/7T 


1 g D- 1/2 
p 0 \/27rd+ 
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□ 

The next proposition gives conditions for F(z) to be aperiodic. Note that 
the aperiodicity condition given in Proposition 1 is more stringent than the 
condition given in the following proposition. 

Proposition 2. If the periods of Sq(z) (if sq > 0), S(z ) (if s > 0), 
Po(z)Q(z)/(poq) and P(z)Q(z)/(pq) are relatively prime, then F(z) has pe¬ 
riod one. 

Proof. Consider the case when sq > 0 and s > 0. Define G(z,n ) = 
E( 0i o)[^ V °^|C/ = n]. Let |zo| = 1- To have F{zq ) = F(l), we must have G(zo,n) = 
G(l,n) for all choices of n. For n = 0, setting u = 1 in (6) implies that 
Sq(zo)/so = 1. For n = 1, setting u = 1 in (7) implies that Pq(zq)Q(zq) / (poq) = 

1 and S(zq)/s = 1. Similarly, for n = 2, we need Po(zo)P(zo)Q(zq) 2 / (popq 2 ) = 

1 and S(zo) = 1. Thus, we must have Sq(zo)/so = 1, S(zo)/s = 1, Po(zo)Q(zo)/(poq) 
1 and P(zq)Q(zq) / (pq) = 1. By an argument similar to the proof of Lemma 
2, we must have zq = 1. Consequently, F(z) is aperiodic. □ 

4. Spectral radius of J 7 for a nearest neighbor random walk. As in the 

beginning of Section 2, let J 7 be the Feynman-Kac transform associated 
with a Markov additive process with transition kernel J. Under certain as¬ 
sumptions on J, Proposition 3 below gives the spectral radius of J 7 . Propo¬ 
sition 3 is Proposition 10 in [10]. Instead of the proof in [10], which appealed 
to the theory of large deviations, we give an algebraic proof using the results 
in Section 3 and the generalized Ney-Nummelin representation for r(J 7 ) in 
Lemma 1. 

The assumptions needed on J are identical to the assumptions on T in 
the beginning of Section 3, except that there is no killing; that is, k = 0. In 
the proof of Proposition 3, we crudely twist the kernel J obtaining a kernel 
denoted by X that may have a killing on the boundary. After giving the 
proof of Proposition 3, we will show how the crude twist can be refined to 
give a harmonic function for J for the nearest neighbor case. This approach 
will be generalized in the next section. 

As in [10], define 

= E y > 0 and 

x'v' 

(18) 

R~( 7,0) = E 

x',y' 

Note that R + — 1 and R~ — 1 are identical to the functions M + and M 
used in our companion paper [9] and that R + is strictly convex. 
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Proposition 3 (Ignatiouk-Robert). For each real 7, let Po = A)(7) be 
the unique value of (3 that minimizes R + ( r y,P). 

1. If the bridge condition R~ ( 7 , Po) < R + ( r y,Po) holds, thenr{J^) = R + ( 7 , /?o) - 

2 . If the jitter condition R~( 7, /So) > i? -1- (7, /?o) holds, then there is a unique 
Pi (7) < Po (7) such that R~,/3±) = R + ( r y,/3i) and r(J^) = R + ( r j,Pi). 


Proof. For any y > 0, let u = 11(7) = J 7 (y, y + 1), d = ^(7) = J 7 (y, y — 1) 
and s = s(y) = J 7 (y,y). Hence, R + (7,/?) = + s + de - ' 3 , exp(/?o) = \fdfu 

and R + (7, /?o) = s + 2 y/ud. 

Assume the bridge condition holds. Define 




J{(x,y)-,{x',y'))e^ xl 


-x) e Po (y'-y) 


f 


where / = R + ('y,Po) = s + 2 y/ud is chosen so that Yh( x ', y ') Z((x, y); (. x',y ')) = 

1 for all y > 0. Note that I is the probability transition kernel of a Markov 
additive process (Vo, Zq) with a possible killing at y = 0 as described in the 
last section [since R~( 7 ,/?o) < R + (l,Po))- Also note that the choice of /3q 
forces p = q. 

By Lemma 1 , R( J 7 ) = sup{n: Hi( 7 , u) < 1 }. Next note Hi ( 7 , u) = E( 0 ,o) [( u fY] 
(where t is the first time Zq returns to zero) since all the factors involv¬ 
ing exp(/3o) cancel out over trajectories which start and return to y = 0 . 
Therefore, for a given 7 , 


R{J^) = sup{u: E( 00 ) [(uf) T ] < 1}. 


However with p = q, using ( 12 ), we see i?(J 7 ) = 1 //; that is, the spectral 
radius of J 7 is R + ( 7, /?o) • 

Now assume the jitter condition holds. By the argument following Propo¬ 
sition 9 in [ 10 ], we see there must exist a unique / 3 i (7) < /So (7) such that 
R~ (7, Pi) = R + (7,/3i). Moreover, R + {pf,j3) is strictly decreasing for [3 < 
/So(7) so the derivative of R + ( 7,/?) is negative at (3\. 

Define 


I((x,y)-,(x',y')) 


J((x,y);(x',y'))e^ x ' 


-x) e !h{y'-y) 


f 


and / = i? + (7,/?i); thus, X is the probability transition kernel of a Markov 
additive process (Vq,Zq) without a killing at y = 0 as described in the last 
section. Again the spectral radius of J 7 is / times the spectral radius of 
X. However, the mean drift of Zq is obtained by taking the derivative with 
respect to (3 of R + ('y,f3)/f = + s{y) + d(y)e @)/f and evaluating 

at We already know the derivative of R + ('y,P) is negative at Pi so we 
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conclude Zq is positive recurrent and has spectral radius one. We conclude 
that the spectral radius of J 7 is / = R + ( 7 ,/?i). □ 

We have already remarked that the spectral radius of J 7 is a convex 
function and since the spectral radius of Jo = J is one, it follows that there 
is at most one choice of 7 > 0 such that r(J 7 ) = 1. We will call this point 
a. Now, we show how to refine the crude twist to find a harmonic function 
for J. First, we consider the jitter case. 

The jitter case R~ (a , /So) > R + (a, /? 0 ). In this case the function exp(/3i ( a)y ) 
is a right eigenfunction for J a with eigenvalue R + (a,/3i). Hence, h(x,y ) = 
exp(ax) exp(/3i (a)y) is harmonic for J. We can now perform the h transform 
of J to get the kernel J and we denote the /i-transformed Markov chain by 
(V,Z). The Markovian component has kernel J , where 

P = J{y,V + 1) =uexp(/3i(a)), 

q = J{y,y-l)=dexp{-(3i(a)) and s = J(y,y), 

Po = .7(0,1) = u 0 exp (/Si (a)) and s 0 = .7(0,0). 

Note that Po + = 1 and p<q ; otherwise, J would not have spectral radius 

one. 


The bridge case R (a,/So) < R + (a,/3o). With the parameters a and 
/3o(a) we construct the kernel T which has spectral radius one. Now re¬ 
mark that the function a^{y) = (1 + ny/po) is harmonic for T so, in fact, 
the function h(x,y ) = exp(cuc) exp(,So(a)y)ao(y) is harmonic for J. We can 
now perform the h transform of J to get the kernel J and we denote the h- 
transformed Markov chain by (V,Z). The Markovian component has kernel 
J. where 


, At \ 1 \ °o(y +1) l + «(y + l)/po 
p(y) = J{y, y + l) = u -= u- 


q(y) = J(y,y-l)=u 


Mv) 

Mv - x ) 

Mv) 


= u- 


1 + ny/po 

, 1 + n(y - 1)/po 

1 + ny/p 0 


s(y) = J(y,y) = s, 


for y > 0 and 

J{ 0,1) =Po^|^y =po(1 + k/pq), .7(0,0) = s 0 . 

If the bridge condition holds with an inequality (and n > 0), then the 
kernel J is transient. To see this we remark that there is some probability 
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of drifting to plus infinity without ever hitting zero because the criterion for 
transience is that 


tt q(l) • • • q(k) 


< oo. 


By telescoping, the above sum is 


OO 


E 

n= 1 


Po(po + n) _ 

{p 0 + K,n)(p 0 + n(n + 1)) 


< oo. 


If the bridge condition holds with equality (and k = 0), then (3o(a) = f3i(a) 
and the function h(x,y) = exp(ax) exp(/3i(o:)y) is harmonic for J. The h- 
transformed Markov chain (V, Z) has a Markovian component with kernel 
J with p = q, which is null recurrent. 


5. The h-transform approach and a ratio limit theorem. The last sec¬ 
tion gave the exact asymptotics for Markov additive processes whose Marko¬ 
vian part is a random walk with a boundary. In this section we allow the 
Markovian part to be a general Markov chain on a countable state space. 
We assume that J has a positive harmonic function h\ that is, h > 0 and 
Jh = h. Furthermore, we assume that h has the form h(z ) = e azi h(z), where 
a > 0. We use h to construct the twisted process (V[n], iJ[n]) having tran¬ 
sition kernel J(z,x) = J(z,x)h(x)/h(z). We use caligraphic letters for the 
twisted process. The probabilities of the two processes for a sequence of 
states x[0],x[l],..., x[n] in Z x S are related via the following change of 
measure: 

PT{(V[n},Z[n}) = x[n\,...,(V[l},Z[l]) = x[l]\(V[0},Z[0])=x[0]} 

= Pr{(V[n],^[n])=x[n],...,(V[l],^[l])=x[l]|(V[0],Z[0])=x[0]} 
x h(x[0])/h(x[n]). 

Our goal is to investigate the asymptotics of G(z, (£,x)) as i —► oo, where 
G is the Green function of J, 

OO 

G(z,x ) = jn ( z ’ x )> 

n =0 

which gives the expected number of visits to any state x starting from any 
state z. Unfortunately, we cannot obtain sharp asymptotics as in Section 3. 
Our main result is a ratio limit theorem for G(z,(£ + r,x))/G(w,(£,y)) as 
l —> oo. 

Define the Green’s function 

OO 

G(z,x) = Y'7 n ( z i x ) 

n =0 
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of J. The Green’s function G of J are related by G(z,x) = Q(z,x)h(z)/h(x). 
We find it easier to investigate the asymptotics of G by studying Q since 
V[n] will be assumed to drift to +oo. As a consequence of the drift, (V,Z) 
is transient and Q and G are finite. 

Note that the marginal processes Z = Z[0], Z[l],... and Z = Z[0], Z[l],... 
are Markov chains, and we denote their transition kernels by J and J , 
respectively. We are interested in the case when J has spectral radius 1 and 
is either 1-transient or null recurrent since this will be needed in analyzing 
the “bridges” of the modified Jackson network, which fall outside of the 
scope of [8, 14]. 

The papers [8, 14] consider the case when J is positive recurrent; in 
this case, under reasonable assumptions, lim^_> 0 0 Q(z, (£,£)) converges to a 
positive limit, which is a function of the invariant probability measure of J 
and the speed at which V drifts to positive infinity. However, when J is 1- 
transient or null recurrent, it does not have an invariant probability measure 
and lim e->ooG(z, (£,x)) = 0. Instead, we consider the ratio 

G(z, (£,£)) 

G{w,{£,$)) 

as £ goes to infinity. 

The assumptions we need on the Markov additive processes (V,Z) and 
(V, Z) for our main result are the following: 

AO. The transition kernel J has a positive harmonic function h(z ) = e azi h(z), 
where a > 0. 

Al. There exists a t> a and M such that E(exp(fF[l])|Z[0], Z[l\) < M 
for all Z[ 0] and Z[ 1]. 

A2. J is irreducible. 

A2.5. Define to be number of steps for Z to return to some state JsS'. 
We assume that the distribution of P(q^\{V[Ts] = •) is not concen¬ 
trated on a subgroup of the integers. (This is Condition (P(l)) in 
[ 14 ]). 

A3. V[n] —> oo almost surely as n —► oo. 

A4. S has spectral radius 1. 

A5. S has an invariant measure tp, which is unique up to constant multi¬ 
ples. 

A5.5. We assume that constant functions are the unique harmonic functions 
for S- (This is the strong Liouville property; see [24]. Note that A5.5 
automatically holds when S is null recurrent.) 

A6. J is irreducible in the sense that the probability p((0, x), (0, y)) of 
going from (0,x) to (0, y) is positive for any x,y £ S. Also, there 
exists an integer N and p > 0 fixed such that for any y, there exists 
an integer m = m(y) such that 1 < m < N and l 7 m ((0, y), (1, y)) > p. 
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(Assumption A6 implies A2; however, we keep both since we believe 
A2 is necessary, but A6 may be too strong.) 

A7. There is some state a and a function / such that uniformly in s, 

G((0,x),(s,&))/g((0,&),(s,a)) < f{x), 

where 

^ J(z,x)f(x) < oo 

x€S 

for all states z. [A sufficient condition for A7 is that (V, Z ) has bounded 
jumps. To see this, let p((0,x), (0,cf)) be the probability of ever going 
from (0,x) to (t,a). Clearly, 

pH 0, O'), {s, &)) > pii o, <t), (0, x))p((0, x), (s, a)). 

Hence, 

g((0,x),(s,d)) = p((0,g),(8,ff)) < 1 

^((0,d),(s,d)) p((0, a), (s, a)) ~ p((0, d), (0, x))' 

For A7 to hold it, therefore, suffices that the range of 77((0, z), (•, •)) 
is finite for all z.J 

A7*. Condition A7 holds for the Green’s function of (—V* [n] , iJ* [n]), where 
(' V*[n],Z*[n] ) is the time reversal of (V*[n], Z*[n)) with respect to (p. 
(The purpose of the minus sign in (— V*\n\, Z*[n\) is simply to have 
the process drift to the right; that is, to also satisfy condition A3.) 

We also use the following convention throughout. For real valued functions 
/ and g, let f(£) ~ g(£) mean that lim^oo f(l)/g(£) = 1. 

Theorem 1. Under assumptions A0-A7 and A7* with w,x,y and z 
fixed, 

Gjz,H,x)) ~ <p(x) 

0{w, (£,y)) <p(y)’ 

which implies 

G(z,(£,x )) h(x)ip(x) hiw) 

G{wfi£,y)) h{y)(p{y) h(z) 

The proof of Theorem 1 is broken up into proving each of the following 
over the next few sections: 

GHHz),H,y)) ~£((M),(^,2/)), 


(19) 

( 20 ) 
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( 21 ) 

( 22 ) 

(23) 


£((0 ,y),{£,x)) 


£((0 ,y),(t,y)), 

¥>(®) 


£((0 ,y),(£,y)) <p(y) 


for all s,z,y,x but a satisfying A7 and A7*. 

Equations (22) and (23) combine to give the first result in Theorem 1, 
and the second result immediately follows from a change of measure. Equa¬ 
tion (19) implies that terms of the form ce~ s£ make an asymptotically negli¬ 
gible contribution to G((0,y), {£,y))- Using this, we derive (20), which shows 
that asymptotics are unaffected by changing V[0]. To show that the asymp¬ 
totics are also unaffected by changing Z[0], we show it for the target (£,&), 
where a satisfies A7. Once there exists a such that (21) holds (whether A7 
holds or not), the result is extended to all y S S, giving (22), which implies 
that the asymptotics are not affected by the starting state. To obtain (23), 
the same arguments are repeated on the process (—V*\n\,Z*\n\), where * 
denotes the time reversal with respect to the invariant measure ip. 

Since (20) is equivalent to G((0, z),(£, y)) ~ G{(0, i), (£ + 1, y)), the re¬ 
sult might initially appear to follow directly from renewal theory using 
A2.5. However, consider the following: Chung ([2], page 50) gives an ex¬ 
ample of an irreducible, aperiodic Markov chain with transition matrix P 
such that limsup n _ >oo P n+1 (0,0)/P"(0,0) = oo. Let Z[t\ be that Markov 
chain, and consider the Markov additive process (V[t],iJ[t]) = (t,Z[t\). Since 
G((0, 0), (£, 0)) = P t ( 0,0), we have lirnsup^^ £((0,0), {£+1, 0))/g?((0,0), (£, 0)) 
oo. Now modify the transition kernel of the Markov additive process (t, Z[t]) 
to allow the process to either remain in the same state with probability 1/2 
or to jump as before with probability 1/2. Since this simply doubles the ex¬ 
pected number of visits to any state, we still have limsup^tx, (?((0,0), {£ + 

1,0))/C?((0,0), (£, 0)) = oo, which violates (20). Note that A6 fails for this 
example. 

Kesten in [11] studies ratio limit theorems for a transition kernel P having 
spectral radius r. In Theorem 1 of [11], (1.4u) implies that there is a unique 
(up to constant multiples) positive harmonic function h\ that is, a unique h 
such that Ph = rh, while (1.4d) implies there is a unique invariant measure 
<p (up to constant multiples); that is, <pP = rp (though only for the the state 
space specified in [11]). In this case Theorem 2 in [11] becomes 

(24) Urn = r k , 

e^oo P £ (w,x) h(w)<p(x) 

His ratio limit theorems with r = 1 are closely related to our study of 
the asymptotics of Markov additive processes (V,Z) satisfying A0-A7. The 
level crossing process (t,U[t]) associated with a nearest neighbor Markov 
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additive process (V,Z) is a Markov chain with kernel P and spectral radius 
1. Clearly, 

(2t .s Ei,P £ (z,v) 0 ,v),( 0 ,y)) = g(( 0 ,z),(£,y)) 

J2vP e (w,v)-Q(( 0,v),(0,x)) ff((0,w),(£,£))’ 

so the ratio of the Green’s functions will converge if the ratio limit theorem 
for the level crossing process holds. 

Our Lemma 5 implies Lemma 4 in [11], and our assumption A 6 is equiv¬ 
alent to (1.5) in [11] (and basically the proofs are the same). Theorem 2 
in [11] requires (1.4u) and (1.4d), which essentially mean that the range of 
transitions are bounded—an assumption that we need to avoid because P 
has unbounded jumps if the underlying Markov additive process has neg¬ 
ative increments. Instead of (1.4u) and (1.4d), we simply assumed in A5 
that the invariant measure is unique up to multiplication by a constant and 
in A5.5 that the only positive harmonic functions are the constants. How¬ 
ever, in order to push through the argument giving ( 21 ) and its analog for 
the reversed process without the bounded jump assumption, we added the 
uniform integrability assumptions A7 and A7*. These assumptions may be 
too strong. However, some additional assumption is needed since Section 5.5 
contains an example satisfying A0-A6, yet ( 21 ) fails. 

5.1. Proof of (19). By the convexity of r(J 7 ), it follows that there can 
be at most one point 7 > 0 such that r( J 7 ) = 1; that is, when 7 = a. Note 
that J a ((xi,y),(yi,y)) = y), (yi, y)), where a was given in assump¬ 

tion AO. Consequently, J™(y,y) = J n (y,y). Thus, they have the same radius 
of convergence, that is, R(J a ) = R{J)- By A4, the spectral radius of J = 1 
so 

r{J a ) = r(J) = 1 ; hence, R{J a ) = R(J), 

and both kernels are either 1 -recurrent, 1 -null recurrent or 1 -transient. 

Note that 

^( r 7,u) = ^2f^{y,y)u n 

n 

= w n J 7 (y,y[l])J 7 (y[l],y[2]) x ••• 

n 

x J'yivin ~ 2},y[n - l])J 7 (y[n - 1 \,y[n]) 


= E 

n 

X\ 


u n J 7 ((0,y),(xi,y[!]))J 7 ((xi,y[ 1 ]),(x2,y[2])) x 
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x J 7 ((x n _i,y[n-l]),(x n ,y)) 

E u n e^J((0,y),( Xl ,m) 

n 

XI r ..,X n 

yW¥=y,---,y[n-i]^y 

x J((xi,y[i]),(x 2 ,y[2})) x ••• 
x J((x n -i,y[n- 1 ]),(x n ,y)) 

= E (o ,y){.^ V[T ^u T yx{Ty < oo}). 

We introduce the random walk U given by V when Z returns to y, where y 
is any fixed point in S. Assume U starts with initial state 0. The (defective) 
density of the increment of this walk is given by 

fu(v)=Pr(V[^}=v,Ty<oc\(V[0],Z[0]) = (0 ,y)), 

where 7} is the first time Z returns to zero. 

Define the transform = Yl v fu(v)z v of fy. Let 

p(x ) = Pr(the first weak descending ladder point of U is at x ), 

OO 

y(x) = E Pr(7Y n = x and U m > 0 for 1 < m < n). 

n =0 

By duality (duality lemma, [5], page 395), p{x) is equal to the probability 
that x is a strictly ascending ladder point of U. Let T p (z ) = J2 x <o zX P( x ) 
and 'S'^z) = J2 x >o zX P( x ) be the transforms of p and p, respectively. 

Lemma 3. The radius of convergence of^y(z) is sup{rt : 'kw('u) < 1}. 

Proof . We cite the following facts from [5] . p + p = 5 x p + p* fu- Taking 
transforms, we obtain 

( 26 ) = 

Since V[n] —> oo as n —> oo, it follows that the return distribution is defective 
so *1 ’p(z) < 1 for z > 0. Therefore, the radius of convergence of is equal 
to sup {u:^>u(u) < 1} [since ^u{z) has radius of convergence at least one 
since U is a (defective) random variable]. □ 

Note that 

T(ct + /3,1) = E( 0 ^)(exp((a + P)V[Tg]){Tp < oo}) 

= E (o,y)(exp(/3V[7^]){T^ < oo}) 

= E fs(v) ex P(f jv ) = (exp (/?)). 


(27) 
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Lemma 4. The radius of convergence of^u(z) and is 1. 

Proof. r(Jo) = r(J) < 1 and r(J a ) = r(J) = 1 . Since r(J 7 ) is convex, 
we conclude r(J a+ g) > 1 for /3 > 0 so R(J a+ p) < 1 for j3 > 0. By the above, 
4'5(exp(/3)) = ^(a + /?, 1). Also, by Lemma 1, for any (3 > 0, 

supjw: + /?, u) < 1} = R(j a+ p) <1 so ^(a + /3, 1) > 1. 

By Lemma 3, the radius of convergence of d's is given by 

sup{u: 'hs(tt) < 1} 

= supjexp(/3): T 5 (exp(/3)) < 1} 

= sup{exp(/3): 4/(a + /3,1) < 1} = exp(0) = 1. 

Hence, the radius of convergence of 4/5 is one, and by Lemma 3, the radius 
of convergence of 4/^ is one as well. □ 

Consider the Markov chain A{£) having kernel A, which represents the age 
of the ladder height process at time l. The probability n(£) is the probability 
that the age at time i is zero; that is, n{£) = P(A(£) = 0) = Mq 0 - Next 
(«4 q o) 1 ^ the spectral radius of A, so we conclude /i(L) 1 ^ —> 1. Let 

m(y) be the expected number of visits to (0 ,y) by (V,Z) starting from the 
point (0 ,y). Clearly, 

m(y) > Q(( 0, y), (£, y)) > /j,(£)m(y). 

Since y ,{£) 1 /^ —> 1, this means lim^_ >oo (^((0,y), {£,y))) 1 ^ = 1. 

5.2. Proof of (20). 

Lemma 5. Under assumptions A0-A6, 

g((0, z), (£ + l,y))/g((0, z), (£,y)) -> 1 . 

For modified Jackson networks the asymptotics of <J((0,0), (^,0)) are cal¬ 
culated explicitly in Proposition 1 and can be directly shown to satisfy the 
conclusion of Lemma 5. 


Proof. Let X k = V[/c] — V[k — 1]. By Al, 
P{V[n\>£\Z[0\ = z,V[0\=0) 


< e~ u E 


W‘£ 


X k 


Z[0\ = z,V[0] = 0 
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< e~ U E E 


^exp ^ X k 


Z[k],k = l,2,...,n:Z[0]=z,V[0]=0 


Z[0\ = z,V[0}=0 

< e~ u M n . 

Next, for any k > 0, 

£ P{Z[n] = y, V[n] = £ + 1| V[0] = 0, Z[0] = z) 

n =0 

<£p(v[n]>*) 

71=0 


Ml 

< £ e~ u M n < e~ u M Kt /{M - 1 ), 

71=0 

where [x] is the integer part of x. We pick k sufficiently small so that s = 
exp(— t)M K < 1. Hence, we can decompose 

OO 

(28) 0((0, z), (l + 1, y)) = Y, P(Z[n] = y, V[n] = £ + 1\Z[0\ = z, V[0] = 0) 

n= 0 

into a main part 

OO 

(29) Y P(Z[n] = y,V[n]=£ + l\Z[0]=z,V[0]=0) 

n=Kd. 

and a negligible part. We take negligible to mean that a term like exp(— si) 
is negligible compared to Q((0,y), (£,y)) as i —» oo. Such a term is negligible 
because lim^_ >oo (C/((0, y), (£, y))) l P = 1; that is, the potential does not die 
out exponentially fast. By assumption A2, 0,1), (0 ,y)) > 0 for some m. 

It follows that 

(30) Q((0,z), (£,y)) > (0,y))6?((0,y), (£,y)) 

modulo the negligible probability that V exceeds l in m steps. Consequently, 
if a term is negligible compared to G((0,y), (£,y)), it is negligible compared 
to G((0,z),(£,y)). 

Without loss of generality, we can assume there is a minimum probability 
the Markov additive process (V[n],Z[n\) stays put during any transition. 
By assumption A6, there is a fixed minimum probability that the Markov 
additive process (V[n],Z[n]) makes a transition from (0, z) to (1,5) after N 
steps. Hence, 

min{ l 7 JV ((0, z), (0, z)), z), (1, z))} > S uniformly in z. 
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We can use the Bernoulli part decomposition developed in [3] and [13] to 
represent 

N n 

V[n] =U[n] + 

k =1 

where L\, L 2 , ... are i.i.d. Bernoulli random variables independent of {(U[n\,N n );n 
1,2,...} such that P(L\ = 0) = P{L\ = 1) = 1/2 and where N n is a Bernoulli 
random variable with mean nb and variance nb( 1 — 6), where b = 8/N. 

N n and U[n\ are dependent. In effect, we have a probability 5 of picking 
up a Bernoulli step every N transitions. 

We can represent (29) as 

00 / N„ 

E P[z[n\=y,U[n] + '£,L k = e + 1 

u=k£ \ k =1 


oo n m 


(31) 


= E J2J2 p ( z ^ = y’ u \ n \ =i ~ x ’ Nn = 

n=ni m— 1 x=l 


m ) 


E Lk — x + 1 J ■ 

Pick e to be small and such that 0 < e < b. For any to, we can bound the 
large deviation probability 

P(\N n — nb\ > eto) < exp(—Ain) where Ai > 0, 

as in [22], Example 1.15. Therefore, we can decompose (31) into a main part 

oo m 

E E ^P(Z[n\=y, u [n\=£- x , N n = m) 

n—Kt m: \n—bn\<en x=l 


(32) 


and a negligible part 


x P I L/- — x 1 
V k =l ) 


E E ^P(Z[n\ = y,U[n\ = £-x,N n = m)p{ ^L k = x + l 

n=K,l m : \n—bn\>en x=l \ k=l / 

oo 

<E E P(N n = m) 

n=K,i m: \n—bn\>en 
oo 

< Y exp(-Ai to) 

n=ni 

= exp(— k£Ai)/(1 — exp(—Ai)). 
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We can now expand (32) into a main part 


(33) 


E E E P{Z[n] =y,U[n] =l-x,N n = m) 

n=K,i m: \m—bn\<en x : \x—m/2\<em 

x ' p ^E ifc=:r + 1 j 


and a negligible part 

OO 

E E E P(Z[n\=y,U[n\=l-x,N n = m)P 

n=K,i m: \m—bn\<£n x: \x—m/2\>em 

x(±L t = X + l) 


< E E P(Z[n\ =y,N n = m)exp(-A 2 m) 

n=hil m : \m—bn\<£n 
oo 

< E E exp(-A 2 m) 

u=k£ m>(b—e)n 
oo 

< E exp(—A 2 (fe — e)n )/(1 — exp(—A 2 )) 

n=K,£ 

< exp(-A 2 {b - e)k€)/ ((1 - exp(—A 2 (6 - e)))(l - exp(-A 2 ))), 

where the constant A 2 > 0 is given in [22], Example 1.15. 

We can now focus on (33), 


P ^ E ~ x + 1 J ~ 


m 

x + 1 ) 2 


‘Ashy f 


For x such that \x — m/2\ < em, we have 


1/2 —e <m — x< 1/2 + e 


1/2 + e + l/m x+l 1/2 — e 

If, in addition, \m — bn\ < era, we can simplify the left-hand side of the above: 


1/2-e 


< 


771 — X 


1/2+ e + l/(ra(6 + e)) x + l 
Finally, when ra > k£, we get 


fi = 


1/2 -e 


m — x 1/2 + e _ 

<-< —-= j 2 . 


1/2 + e+l/((6 + e)/c£) “ x + l ~ 1/2-e 
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We can therefore bound (33) above and below by multiplying fi and f±, 
respectively, by 


(34) 


EE E P{z[n] = y,U[n]=£-x,N n = m 

n=K,£ m: \m—bn\<en x: \x—m/2\<£m \ / 


If we now add the negligible terms back into (34), we get that (31) is 
bounded (modulo negligible terms) above and below by multiplying /2 and 
fi, respectively, by 


E p pM 


n =0 


N n 

yM[n] + E L k 
k =1 


£((0 ,z),(£,y)). 


Hence, 


1/2 -e 

1/2+ e 


< liminf 

(,—>-oo 


g((0,z),(£+ 1,^)) 
^((0,i),(^,y)) 


< lim sup 

^—>oo 


£((M),(l + !, j/)) 
£((M),(^y)) 


< 


1/2+ e 
1/2-e 


and since e can be taken arbitrarily small, the result follows. □ 


5.3. Proof of (21 )— uniform integrability. 


Proposition 4. Under assumptions A0-A7 

G((t,z), (£,&)) &),(£, a)) as £ > oo . 


Proof. Define 


B u(s,x) 


g((s,x),(£ n ,a))/g((0,a),(£ n ,a)). 


Take a subsequence l n such that Be n (s,x) converges to B(s,x ) for all (s,x) 
as £ n —> oo. By Lemma 5, B(s,x) = B(x). 

We can write 


(35) 


= E + 

(s,x) 


J{(t,z),(£ n ,a)) 

g(( 0 ,a),(£ n ,a))' 


By assumption A.l, J({t, z), (£, a)) above decays exponentially fast as £ —► oo 
so the second term on the right-hand side of (35) tends to zero as £—> oo. 
Moreover, 


J((t, z), (s, x)) = J(z, x)J(z,x){s ~ t ) 
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where <J(z,x) ( s — t) is the probability the additive transition equals s — t given 
there has been a transition from z to x, 

p ( _ £(0,f),(4,d)) _ G((s,x),(£ n ,a)) £(0,d), (4,d)) 

6?((0,d),(4,d)) 0(( a ,d),(4,d))0((O,d),(4,d)) 

and the first fraction is bounded by f(x) by A7. Moreover, 

y(M)/(«) < 00 

x 

for all z. 

If p((0, d), (t,d)) is the probability of ever going from (0,d) to (f,d), then 
P(( 0, d), (4, d)) > p(( 0, d), (s, a))p((s, a), (4, d)). 

Hence, 

g((s,d),(4,d)) = p((s, d), (4i d)) < 1 

^((0,d),(4,d)) p((0,d),(4,d)) “ p((0,d),(s,d))' 

l/p((0,d), (s,d)) increases at a subexponential rate in s and, hence, is inte¬ 
grate in s with respect to J(z,x) ( s ~ t) since J(z,x) (s — t) decays exponentially 
fast in s uniformly in z,x by Al. 

We conclude that Bi n (s,x) is bounded uniformly in i n by /(x)/p((0,d), 
(s,d)) and 

Y J({t,z),(s,x))f(x)/p((0,&),(s,a-))<oo. 

(s,x) 

Since Bi n (s,x) converges pointwise to B(x), dominated convergence implies 
that Bi n (s,x ) converges in L 1 relative to the measure J'((t,z),(s,x)) and 
that 

B(t,z) = Y J'((. t ^),{s,x))B(s,x) 

(s,x) 

or 

B(z) = YJ(z,x)B(x) 

X 

by Lemma 5. This means B(z) is harmonic for J. By hypothesis, the con¬ 
stant functions are the only harmonic functions for J and B(a) = 1 so 
B(s,a) = 1 for all (s,z). Since this limit is independent of the subsequence 
4, it follows that 


lim g((t,z),(£,a))/g((0,d),(£,a)) = 1. 


□ 
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5.4. Proof of (22). 

Proposition 5. 

/o fi \ QM£,y)) <_1_ S(z,(£,a)) 

£((0 ,y),{£,y)) ~ p((0,y),(0,o-)) 2 p((0,o-),(0,y)) G((0,a),(£,&))' 

Proof. The number of visits to (£,&) is greater than the number of 
visits to (£,y) followed by a visit to (£, a), 

G(z, (£, d)) > g(z, (£, y))p(( 0, y), (0, a)), 

and the number of visits to (£,y) is greater than the number of visits to 
(£,y) that must first go through (0,cf) and then must go through (0,<r) 
before going to (£,y), 

Gm y), (t, y)) > p({ 0 , y), (o, d))C/((0, a), {£, a))p({ 0, a), (0, y)). 

The inequality follows by dividing the above two inequalities □ 


Proposition 6. Under assumptions A0-A7, 

G((s,z),(£,y))~Q((0,y),(£,y)) as £->oo. 

Proof. Define 

Ci n (s,x) :=G{(s,x),(£ n ,y))/G((0,y),(£ n ,y)). 

Take a subsequence £ n such that C^ n {s,x) converges to C(s,x ) for all (s,x) 
as £ n —> oo. By Lemma 5, C(s,x) = C{x). By Proposition 5, 


Ce n (s,x) < 


G((s,x),(£ n ,a)) 


P((0,y),(0,d)) 2 p((0,<r),(0,y)) G((0,a),(£ n ,a))' 


The sequence of functions in (s,ii) indexed by l n on the right-hand side 
above is uniformly integrable with respect to the measure J'((t,z),(s,x)), 
so Ce n (s,x) is uniformly integrable as well. 

Since 


Cl n {t,z) = J((t,z),(s,x))Ce n (s,x) + 


J({t,z),(£n,y)) 
£((0 , y ),( 4 , y ))’ 


(s,x) 

we can take the limit as £ n —> oo to get 

C(x) = y ^J(z,x)C(x). 

X 

Again, we conclude C(x) = 1 and this proves the result. □ 
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Define the time reversed kernel by 

J*(w,z) = ip(z)J(z,w)/ip(w). 

J* is the kernel of the time reversed process W* = (V*,Z*). Define the 
Green’s function, Q* by 

OO 

G*(z,w) = Q*((zi,z), ( wi,w )) = ^{J*) n {z,w), 

k =0 

Z* has kernel j*(x,z) = ip(z)7T(z,x)/cp(x) and J* has unique (up to con¬ 
stants) invariant measure ip and harmonic function 1. 

Proposition 7. Under assumptions A0-A6 and A7*, 

S((0,y),(£,x))/g((0,y),(£,y)) -> as oo. 

Proof. It is easy to see — W* [n\ satisfies assumptions A0-A6. Moreover, 
A7 holds for —>V*[n] because A7* holds for W. Consequently, 

£*((M),(-Ay))/0*((O,y),(-^,y))-» l as f-*oo 

by Proposition 4 since the constant functions are the unique harmonic func¬ 
tions for J*. By time reversal, this means 

^ : ^||yl/((0,y),(£,x))^ j (^j|y£((0,y),(£,y))) -> 1 as £-* oo. 

This gives the result. □ 

Putting Propositions 4 and 7 together we get the following: 

Theorem 2. Under assumptions A0-A7 and A7* 

Q((s,z),(£,x))/g((u,w),(£,y)) -> '^0- as oo 

v{y) 

for fixed s,u,w,x,y and z. 

Using Theorem 2, plus the change of measure from J to J , we get the 
following: 

Theorem 3. Under assumptions A0-A7 and A7*, 

G((s, z), (£, x))/G((u, w), (£, y)) -*• ~ as £ -> oo 

Ky)vvy) Hz) 


for fixed s,u,w,x,y and z. 
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5.5. Assumptions A0-A6 are insufficient for (21). This section gives an 
example satisfying all of the assumptions except for the uniform integrability 
assumptions A7 and A7*, but (21) does not hold. From the discussion near 
(25), it suffices to give a transition kernel J such that (24) does not hold. 
Consider a chain on S = {..., —2, —1,0,1,2,...} with kernel J defined as 
follows: 

J(n,n + 1) = J(n,n — 1) = 1/2 for n > 1 

J(n,n + 1) = 1/3 and J(n,n— 1) = 2/3 for n < — 1 

77(0,n) = /(n) for n > — 1 and /(—1) > 0, 

where / is the probability mass function such that )C()!Lo n /( n ) =oo. We 
could modify the kernel so J(n,n) > e for all n and this will not alter the 
following conclusions. 

This chain is clearly irreducible and transient to minus infinity. Neverthe¬ 
less, it has spectral radius one. Starting from 0, the chain can go to 1 and 
then return to 0 after 2^—1 steps without hitting 0 again. We saw this has 
probability of order l/(2£) 3 / 2 in the preceding section. Hence, 

lim (jf 2 ^(0,0)) 1/2£ = 1. 

£—>oc 

This chain only has constant positive harmonic functions because for n > 1, 
a harmonic function h must satisfy h(n) = - 7 / 1 ( 77 , +1) + 77 / 1(77 — 1). This means 
the harmonic function must be positive and linear on [0,oo). On the other 
hand, we must have h( 0) = h( n ) f ( n ) an d this is infinity unless h is 

constant by the construction of /. Hence, no harmonic functions other than 
constants can exist. 

In spite of all this, Proposition 4 fails with y = 0. Pick a starting point 
x = —n with n even. Once the chain hits 0 the first time after 2k steps, the 
probability of hitting 0 again in 21 — 2k steps is asymptotically the same as 
returning to 0 in 2£ steps since this later probability is of order 1 /(2€) 3 / 2 . It 
therefore follows that 

— 77 ; 0) 

—7 -1-> P(hit 0 starting from —n). 

J 2e ( 0,0) 

We bound the probability of hitting 0 from —n by considering 0 to be 
absorbing and we see the return distribution falls off geometrically fast in 
n. Hence, the probability of a return to 0 can be picked arbitrarily small by 
picking n large. Hence, P(hit 0 starting from — n) is strictly less than one. 
Hence, the ratio limit theorem fails. This is not unexpected since jumps are 
unbounded and A7 fails. 
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6. Asymptotics of queueing networks. As in [8, 14] , we consider a Markov 
additive process W°° with transition kernel K°° on S°° and a boundary 
▲ with an edge denoted by A = S n A such that the probability transi¬ 
tion kernel K of the chain W agrees with K°° within S°° \ A; that is, 
K(x, C ) = K°°(x, C) if x G S and C C S°° \ A. 

We assume W is stable and we are interested in the asymptotics of the 
steady state probability n of W as the additive component gets large. 
We have assumed the existence of a positive harmonic function h(w) = 
h{w ) = ex.p(awi)h(w) for K°° on S°° . We have constructed the /i-transform 
K.°°(z,w) := K°°(z,w) x h(w)/h(z). Let /C°° denote the Markovian part of 
the transition kernel /C°°. We assume (Wf 3 , VV°°) = (V,Z) satisfies A0-A7, 
A7* and B1-B4 given below: 

Bla. Define Green’s function, 


OO 


G(z, y ) = (yi ,y)) = J 2 (^°°) n (^. v)- 


k =0 


We assume that for some fixed state a. 




G((0, a), (£,&)) 


Bib. We also assume 



is bounded uniformly in w G A for l sufficiently large. 


G((0,S’), (£,&)) 

In fact, the uniform boundedness need only be checked on that subset 
of A which can be reached in a transition of W°° from S°° \ A into A . 
B2. There exists a subset C C A such that vr(C) > 0 and such that, for 
z G C, P Z (T£° = oo) > 0, where is the first return time to A by 
W°°. 


B3. For each y. there is an associated integer L(y) such that (£,y) n A= 0 
if £>L(y). 


B4. X(x) = Ti(x)h(x)x{x CA} is a finite measure. 

Lemma 6. If assumption B1 holds, then for any state y and for £ suffi¬ 
ciently large, 


G{z,{£,v)) 


is bounded uniformly in z £ A for £ sufficiently large 


G((0,y),(£,y)) 


G ((0 ,z), (£,&)) 
G((0 ,y),(£,y)) 


is bounded uniformly in z for £ sufficiently large. 


and 
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Proof. By Proposition 5, 

G(z,{i,y)) <c G(z, (£,&)) 

£((0 ,y),(£,y))~ G{(0 ,&),(£,&)) 


where C is a constant. 


The right-hand side is uniformly bounded in z £ A for £ sufficiently large by 
condition Bib. 

The same argument works to prove the second inequality, except condition 
Bla is used. □ 


Theorem 4. Under assumptions A0-A7, B1-B4, for any states y and 
a such that </?(<r) > 0, 


e" 7T (£,y)~fh (y)ip(y) 
where f = £ 2eA 'r:{z)h(z)P z {T^ 0 = o°). 


t g(( Q, <t), (£,&)) 
<p{°) 


Note / is positive by assumption B2 and can be obtained by fast simula¬ 
tion. Also note that if Af°° is positive recurrent, the steady state theorem in 
[8, 14] implies 

G((0,&),(£, a)) 1 ~ ^ t i^ioo 

-—-► — where fi is the mean drift of IV^ . 

ip{a) fi 

Proof of Theorem 4. As in the steady state theorem in [8], for £ > 
L(y), the steady state probability of (£,y) is given by 

(TS °-1 

n(£,y) = n ( z ) E z\ x{W°°[n\ = (£,y)} 

z £A \ n =0 

= J2*(*)Ez(N$(£)), 

ze a 

where N k (£) denotes the number of visits by 1V°° to (£,y) before T£°; that 
is, before W°° returns to A. Also let N(£,y) denote the number of visits by 
W°° to (£,y). 

By the change of measure induced by the twist, we get 

(37) a e Tr(£,y) = h~ 1 {y)J2 7T ( z )h(z)E z (Af A {£,y)), 

z£ A 

where A f k (£,y) is the number of visits by the twisted process. If N{l,y) is 
the number of visits to (£,y) by W 00 , then AT k (£,y) agrees with A f(£,y) if 
W°° never hits A. 

Let m{l,y) =G{(0,y),(£,y))- We now investigate 

(38) ^2 ir{z)h{z) ^ ^ E 2 (A f k (£, y)) 
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as £ —► oo. 

Let = min{n > 0: VVf°[n] > b}, 


oo 


E Mz)p z (Tir < r? < 

zEA 

= E <*) E P *(. T b° < ?? < Wp?) = w)h(w) 

z£A w£A 

= J2 n(w)h(w) E P M* < p :< OO ,W(T1) = z) 

wOA Zg A 

where indicates time reversal with respect to it 
< E ^(w)h(w)P w (T b < T* < oo) 

uigA 

^0 

since A(z) = n(z)h(z)x{z CA} is a finite measure by hypothesis and 7r (W* > 
b) —* 0 as b —* oo. Pick b sufficiently big so that 

E X (z)Pz(T b °° < T™ <oo)<e. 
ze a 

Moreover, by Lemma 6, we can also pick b sufficiently large that 




i 


(39) 


z€A,zi>& 


m(£,y) 


E z(Af A (£,y)) 


< E n{z)h{z) 


zEA,zi>b 


m(£,y) 


E z (N(£,y)) <£ 


for £ sufficiently large. 

For £ > b, we first remark that 


(40) 


z£A,zi<b m \^y) 


= E A z )h(z 

zOA,zi<b 

since b <£. 

Next, we compare (40) and 


1 


m(£, y) 


E z (Ar A (£,y) X {T b °° <??}) 


(41) 


1 


E tt ( 2 )h(z)—Er E 2 (V(£,y)x{r b 00< r-}). 

z€A,zi<6 m P:V) 


The difference is less than 

E ° T?x{ir < tt < <=»}) 


zEA 
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< £ Tr(z)h(z)J2Pz(T b 00 <TZ°<oo,W°°[T™] = 

z£A,zi<b u>GA 

1 


W 


m(£,y) 


E w (Af(£,y)) 


<C K(z)h(z)Y J Pz{T b ™<T?<™,W°°[T™]=w) 

z£A,zi<b uiGA 


using Lemma 6 

<C ^ 'K(z)h(z)P z (T b °° <T£° < oo) 

z£A,zi<b 

< Ce by (39). 

We therefore investigate the asymptotics of (41). Condition on the point 
when W™ first hits or exceeds b. (41) is equal to 

£ *WM*)£ £ fi(wnr] = i+ ) , 

z£A,zi<b 0<s v : v\=b+s 

(42) w°°[r fe °°] = v, r b °° < r A °°) 

i 


m(£,y) 


E 0 ,<)A f{£- (b + s),y). 


However, 


= g((0,u),(£- (6 + s),j))) 

£((0 ,y),(£,y)) 

£((° ,v),(£-(b + s),y)) G((0,y),(£-{b + s),y)) 


1 


^((0,y),(^- {b + s),y)) £((0,y),(^,y)) 

by Theorem 1. The first ratio on the right-hand side above is uniformly 
bounded in v as l —> oo by Lemma 6. Moreover, 


G((0,y),(£- (b + s),y)) 
G((0 ,y),(£,y)) 


< 


1 


P((0,y),(b + s,y)) 


and this is integrable in s relative to P z (yV]°\T b 0 } = b + s), since from as¬ 
sumption Al, the jump sizes and, hence, the excess beyond b are bounded 
in distribution by an exponential. 

Consequently, (42) converges to 

£ *(z)h(z)p,iir<i?) 

z£A,zi<b 
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by dominated convergence. Moreover, 

£ *(z)h{z)P.(ir <T?) 

z£A,zi<b 

(43) —> 7) 7r (z)h(z)P z = oo) = / asfe—>oo. 

ze a 

Equation (38) is within e + Ce of (41) as l tends to infinity. Next, (41) 
tends to / as l and b tend to oo. Since e is arbitrarily small, we conclude 
the right-hand side of (37) tends to h~ l (y)f, that is, 

lirn e al 1 7r(l,y) = h _1 (y)/. 

e^oo m(£,y) 

Finally, we use Theorem 1 to replace Q(( 0, y), (£, y)) by tp{y)G{( 0, a), (£, a))/tp(a)) 
asymptotically. This gives the result. □ 

6.1. Asymptotics of two node networks. Theorem 4 gives the asymptotics 
of the steady state it probability of a discrete time queueing network when 
the queue at the first node gets big. Below we specialize Theorem 4, using 
Proposition 1, to prove Theorem 5 for networks with two nodes. We can con¬ 
sider jump processes because, without loss of generality, we can assume the 
event rate is one, so we can regard the jump rates as transition probabilities 
of a Markov chain W with kernel K on S = {(x, y)\x, y > 0, where x, y £ Z } 
(where Z denotes the integers). Consequently, 7r is also the stationary dis¬ 
tribution of W. 

Now extend S to S°° = {(x,y)\y > 0, where x,y £ Z} and define ▲ = 

{(x, y)\x < 0, y > 0} n S°°. The kernel K agrees with a Markov additive ker¬ 
nel K°° defined on S°° for transitions between points in S°° \ ▲. W°° is the 
free chain with kernel K°° on S°°. The free process W°° is a Markov addi¬ 
tive process. The additive component W°° is the number of customers at the 
first node, and the Markovian component W°° is the number of customers 
at the second node. Markov additive kernels are defined in detail in Section 
2, but we can just extend the definition of K((x,y); (x + u,y + h)), which 
is constant for x > 0, to x E Z. We assume K°° is nearest neighbor in the 
Markovian component. We also assume K°° is homogeneous, which means 
W°° is a homogeneous random walk off the boundary A= {(0, y): y = 0}. 

For y > 0, define 

R + (e 1 ,9 2 ) = Y / K™((x,y)-(x\y'))e e ^'-^e e ^'-^ 

x',y' 

and for y = 0, 

R-(0i,0 2 ) = E tf°°((x,0); {.x\y'))e e ^'-^e^. 

x\y' 
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Theorem 5. The bridge case: Let 8 b be the solution to 


(44) 

e\> 0 

(45) 

d(R+(6 b ,6 b )) 

dd 2 

(46) 

R + (8 b ) = 1 


(a) Suppose R~( 6 b 1 , 6 b 2 ) < R + (0\, d b 2 ). 

(b) We assume that the distributions P(V[ 1] G •|TT oo [0] = (0,1), Z[l\ = 1) ; 
P(V[ 1] G • |TdT°°[0] = (0,1), Z[ 1] = 2) and P(V[ 1] G -| W°°[0] = (0,1),Z[1] = 0) 
[having z-transforms S(z)/s, P(z)/p and Q(z)/q resp .] satisfy the aperiod- 
icity condition given in Proposition 1. 

(c) We assume cascade paths up the y axis can be neglected by requiring 
J2 y >o e 92 V ^(0,y) < oo so B4 holds. We also assume Bl. 

(d) We suppose the mean drift of V above the x-axis is positive; that is, 
d + > 0, where is given at (5) and where the constants k and u = p = q are 
defined as in Section 3, where we define 1 as the h^-transform of K°° with 
ho(x,y) = exp(0^x) exp( 6 * 2 y). Denote the associated Markov additive process 
byWS° = (V 0 ,Z 0 ). 

Then the least action path is the bridge path. If R~( 61 , 62 ) < R + (d\, 82 ) 
(or, equivalently, k> 0), then 

(47) n(£, y ) ~ f b exp(— 6 b £)C + £~ 3 ^ 2 exp (~ 6 %y)cp(y), 

where f b is a constant obtainable by fast simulation, <p(y ) = ^(1 + ny/po ) 2 
and C + is given in Proposition 1. 

If R~ ( 61 , 62 ) = R + ( 61 , 62 ) (or, equivalently, k = 0), then 

(48) n(£, y) ~ f b C 0 £~ l ' 2 exp(-^) exp(-^y), 
where Cq is given in Proposition 1. 

The jitter case: Suppose we can find 6 3 = (d^d^) satisfying 6 {> 0 and 

(49) R + ( 6 j ) = R~(9 j ) = 1. 

(a) Suppose R-( 6 b 1 , 6 b 2 ) > R + ( 6 b , 8 b ). 

(b) We assume the aperiodicity of the distribution P(V[Tf\ G • | W°° [0] = 
(0,0)) of the additive part V ofW°° at the time To when the Markovian part 
Z of W 00 returns to 0. A sufficient condition is given in Lemma 2. 

(c) We assume p < q. 

(d) We assume cascade paths up the y axis can be neglected by requiring 
^y> oe^M°,2/) <°o. 
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(e) We suppose the mean drift of V given at C7 in [8] is positive; that is, 
d j = m(S' 0 (l) + P[{ 1)) + (1 - y>(0))(Q'(l) + S'( 1) + P(l)) > 0, 
where p is a probability measure given at C6 in [8], 

¥>(0) = Fp/po and tp(y) = T(p/q) y 

(5°) _ 

where T = (p/po + p/(q — p)) 

The above constants are defined as follows. Define the harmonic function 
h(x,y ) = exp(0jx)exp (d J 2 y) and construct W 00 , the h transform of K°° hav¬ 
ing kernel KP°. Define P, Q, S, Po and So, as well as p, q, s, po and sq, 
using /C°° instead of 1 as was done near (4). 

Then we have a jitter case and 

7r(^y) ~ f exp(-0^)iexp (~0 J 2 y)<p(y) 
ad 

and f y is a constant obtainable by fast simulation. 

Proof. In the bridge case, take a = 0\. We have to check that conditions 
A0-A7 and B1-B4 in Section 6 hold. These follow almost immediately from 
our assumptions. The /io-transformed kernel Kq 1 (z,w) := K°°(z,w)ho(w)/ho(z) 
satisfies the following properties: 

(a) ho is harmonic for the free process off the x-axis so /Cq°((x, y); (x', y')) 
is a probability transition kernel when y > 0. 

(b) Off the x-axis, the mean vertical drift is 0; that is, 

^^((x,y);( x ',y'))y' = Q when y > 0. 

W 

(c) We have assumed /Cq°((x, 0), •) is substochastic with killing probabil¬ 
ity K. 

Let 1C §° denote the Markovian part of the transition kernel /C§°. Since the 
kernel is nearest neighbor, define 

p = £™(y,y + i), q = £o > (y,y- 1), s = ic^(y,y) 

(51) for y > 0, 

Po = ^o°(0,l)> s 0 = /Cg°(0,0), k = 1 - po - sq . 

Assumption A5 is automatic since /C°° has nearest neighbor transitions 
and it is easy to check that 

¥>(0) = 1 and ip(y) = (y) for y > 0 
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is the unique (up to multiples) cr-finite stationary distribution for AC°°. More¬ 
over, the constants are the only harmonic functions for /C°° since do is the 
unique harmonic function (up to constant multiples) of fC q°. 

By Section 4, the spectral radius of 1C q° is 1. The spectral radius of Af 00 
is the same as and this is 1, so A4 holds. By Proposition 1, if k > 0 and 
d + > 0, then 

OO 

So((0,0);(£,0)) := £(/C8T((0,0); (0,£)) ~ C + i~^\ 

n =0 

where C + is defined in Proposition 1. 

Instead, if k = 0 and d + > 0, then 

So((0,0);(£,0))~C 0 r 1/2 , 

where Co is defined in Proposition 1. Moreover, if n = 0, then ho is harmonic 
for K°°, so ao(y) = 1 and fP = 9 b . 

In the jitter case, take a = 9{. We need to check hypotheses Cl-Cll in 
[8]. These follow immediately from our assumptions, p> is as given since the 
Markovian part is nearest neighbor. □ 

7. Modified Jackson networks. In this section we first give conditions for 
the stability of a modified Jackson network. We then specialized Theorem 5 
to a modified Jackson network with two nodes. 

7.1. Definitions. Consider a Jackson (1957) network with two nodes. 
The arrival rate of exogenous customers at Nodes 1 and 2 form Poisson 
processes with rates Ai and A 2 , respectively. The service times are indepen¬ 
dent, exponentially distributed random variables with mean 1/pi and 1 //U 2 , 
respectively. Each customer’s route through the network forms a Markov 
chain. A customer completing service at Node 1 is routed to Node 2 with 
probability r\p or leaves the system with probability rpo := 1 — rip. Rout¬ 
ing from Node 2 is defined analogously. So without loss of generality, we are 
assuming rip = r^p = 0. The routing process, service processes and arrival 
processes are independent. 

To ensure that the network is open, we assume that < 1- Since the 

network is open, the traffic equations 

(52) \i = Xi + for i = 1,2, 

have a unique solution (A i; A 2 ) = ((Ai+ A 2 r 2! i)/(1 -ripr 2 p), (A 2 + Airi i2 )/(1- 
r i, 2 ^ 2 ,i))- To eliminate degenerate situations, we assume that Ai > 0 and 
A 2 > 0. 

The joint queue length process of this Jackson network forms a Markov 
process with state space S = {0,1,... } 2 . Define pi = Xi/pi for i = 1,2. From 
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Jackson (1957), it follows that the stationary distribution for the joint queue 
length process being in the state (x, y) E S is (1 — pi)pf (1 — P 2 )p\, provided 
that the stability conditions p\ < 1 and p 2 < 1 hold. 

The network that we analyze is a small change from the above network. 

Suppose that Server 2 has been cross-trained and helps Server 1 whenever 
Queue 2 is empty. Let p* > p\ be the combined service effort of the two 
servers at Node 1 when Server 2 is empty. In the section entitled Stability 
in [9], we proved the modified network will be stable if p 2 < 1 and p\ > 

(Ai - p 1 p 2 )/(l - P2)- 

We are interested in the rare event of a large deviation in the number of 
customers at Node 1; that is, more than I customers at Node 1 where I is 
large. We will consider choices of the parameters which eliminate the possi¬ 
bility of a large deviation first up the y- axis followed by a drift over to F 
This means the large deviation paths are along the x-axis as was described 
in Part I. However, if the most likely approach for the Jackson network “jit¬ 
ters” along the x-axis, as p\ increases this approach may eventually become 
sufficiently difficult so that some other approach becomes most likely. In¬ 
stead the process travels along the x-axis, but instead of jittering along the 
x-axis, the process skims above and only rarely touches the x-axis. We refer 
to this path as a bridge path. 

The event rate of the modified Jackson network is A = Ai + A 2 + P 2 + p\ 

(since p\> p\). Without loss of generality, we assume A = 1 so we can regard 
the jump rates as transition probabilities of a Markov chain W with kernel 
K on S = {(x, y)\x, y > 0, where x,j/£ Z}. The modified Jackson network is 
precisely the homogenization of this chain. IT is a nearest neighbor random 
walk in S. Jumps outside of S are suppressed. 

7.2. Asymptotics in the 1-positive recurrent case. In this section we ap¬ 
ply the results in [8] and [14]. Define the harmonic function h(x, y) = exp(0jx) exp^y), 
where fP satisfies (49). We assume P 2 < exp(— Q-f) and p < 1. The associated 
Markovian part of the twisted kernel fC°° is positive recurrent if p < 1 (p 
is given by Theorem 5). The associated stationary probability p is given in 
Theorem 5. The only thing to check is 

OO 

^%)7i-(°,y) < 00 . 

y =0 

This follows because this sum is bounded by YffjL 0 expby the a priori 

bound given in Lemma 1 in Part 1. This is finite if P 2 < exp(— OQ. 

In summary: 

Corollary 1. If P 2 <exp(— 6 3 2 ) and if p < 1 where p = p/q and where 
p,q are defined after (50), then the least action path jitters along the x-axis 
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and (p becomes 


(53) 


<p(y) = 


(l + y~) r P y \ ify>0, 

, ify = o, 


i - p 


where r = (\ 2 e 9 2 + ulri^e 0 i +0 2 )/(/x 2 r , 2 ,oe e 2 + /x 2 r 2 ,ie 6, i e 2 ). 


7.3. Asymptotics in the 1-transient case. In this section we apply the re¬ 
sults in Section 6. We assume p 2 < exp(— Q^), but p > 1. In this case Propo¬ 
sition 1 gives a solution 6 b and we take a in AO to be 0\. A2 holds since 
the network is nearest neighbor in the additive component, as well as the 
vertical component. A2 is true by our assumptions on the Jackson network. 

Pi > Pi > 0 and p 2 > 0 (or else the network cannot be stable). Moreover, 
at least one of Ai > 0 or A 2 > 0 or the network is empty, rgo > 0 or r 2 , 0 > 0 
by hypothesis. Finally, Ai > 0 and A 2 > 0, which means Ai + > 0 or 

A 2 + Ai?T ,2 > 0. A2 follows immediately. 

Next we check hypothesis A2.5. Suppose A 2 > 0. Next suppose r 2 .o > 0. In 
the first case when rgo > 0, then from a point (x,0), the chain W°° returns 
to the x-axis either at (x,0) by going up and down or at (x — 1,0) by going 
left one. Since we can return to both x — 1 and to x, A2.5 is satisfied. In the 
other case when n 2 > 0, then from a point (x,0) the chain W°° returns to 
the x-axis either at (x,0) by going up and down or at (x — 1,0) by going 
northwest one and then down. Again A2.5 is satisfied. 

Suppose, on the other hand, that A 2 > 0 but r 2 $ = 0 so 7 - 2,1 > 0 and 
tt,o > 0. From a point (x, 0) the chain W°° returns to the x-axis either at 
(x — 1,0) taking a step left or to (x,0) by taking a step left, going up one 
and then going southeast. A2.5 is satisfied. The case when A 2 = 0 follows in 
the same way. 

Conditions A3-A5 hold automatically and A6 holds since either Ai > 0 
or A 2 + P 2 r 2 ,L > 0. 

Assumptions B2-B3 hold automatically. As for assumption B4, we remark 
that 

OO OO 

Hy)n(0, y)<Y e ^ a o(y)P 2 > 
y =0 y =0 

so assumption B4 holds if e e ^p 2 < 1. Note that this is precisely the condition 
that appears in Theorem 1 in Part I, ensuring that the least action path 
is the bridge path or the path jittering along the x-axis. Note also that we 
have appealed to the special structure of the Jackson network, but in a more 
general case we could use Lyapunov functions. 
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This leaves assumption Bl. It suffices to show that the ratio <J((0, y ), (£, 0))/<J((0,0), [£, 0)) 
is bounded uniformly in y as l —» oo (i.e., we take a = 0). For paths uj' of W°° 
starting from (0,0), define N^^^uj') to be the number of visits by W °° to 
(£, 0) following the trajectory u/. Also define B to be the set of trajectories 
where the x-coordinate VVf 3 stays nonnegative, that is, B = {u/iVVf^n] > 

0,n > 0}. Similarly, for paths uj of W 00 starting from (0 ,y), define N^^(u) 
to be the number of hits at (£, 0). 

Now consider the product space of all paths uj of W 00 , which start from 
(0 ,y) times paths uj' which start from (0,0). On this product space we can 
define a coupled path starting from (0,0), which follows u / until u/ hits the 
path uj and then follows uj. Given a path uj which hits {£, 0), we note that all 
paths uj' E B must hit the path uj because the path uj 1 is trapped between the 
x-axis and the path uj and there are no northeast or southwest transitions 
for Jackson networks. 

Define Nmq\{uj,uj') to be the number of hits at (£,0) by the coupled path. 

Then, for uj' G B and any path uj, Nwq^uj) < N^^(uj,uj'). Hence, 

E(o,»)%,o)M ' - p (o,o)( w/ € B) = E( 0 ,i/) ® E(o,o)(^,o 

< E(o t3/ ) <8> E( Oi o)(A^(£ jO )(a;,a; , )XB( w 0) 

^ E(o t3/ ) ® E^q^-A^o)^, w 0) 

= E(o,o)(^,o)( w/ ))- 

We conclude G{(0,y), (£,0)/G(0,0), (£,0) < P^ 0 )(uj' € B ) _1 ; that is, the ratio 
is uniformly bounded in t and y: 

Remark that the special structure of the modified Jackson network was 
not really needed to make the above argument work. Bounded jumps are 
enough. 

We can now apply Theorem 5. Since the mean vertical increment is zero, 
we can simply use the following values: 

u = p = q = A 2 exp($ 2 ) + Mm ,2 exp(-0i) exp^), 

Po = A 2 exp(6>2) + MiD,2exp(—0i)exp(02), 
s 0 = Aiexp(0j) +Mi»"i,oexp(-0j)exp(0^), 
k = 1 - p 0 - s 0 

and 

= —Mm,2^1 X A 2 + m 2 i~ 2 ,iA\A 2 1 + (A1A1 — Mm,0^1 X ) 


in the bridge case. 
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7.4. Asymptotics in the 1-null recurrent case. There are practically no 
changes from the 1-transient case, k = 0 if and only if 9 h also satisfies 
R-(0 b ) = 0; that is, if and only if 9 b = fP. In this case p = 1 and p(y) = 1 for 
all y. The application of Theorem 5 is immediate. 


8. A comparison with existing results. A referee asked us to compare our 
results with existing results in the literature in [4] . This paper describes two 
processors with service rates, pi at server one and p 2 at server two, serving 
independent streams of Poisson arrivals with rates Ai and A 2 , respectively. 
When one server becomes idle it helps the other server and the rate at server 
one becomes p\ when server two is idle and the rate at server two becomes 
P 2 when server one becomes idle. This, nearly a modified Jackson network 
with ri 2 = 7"2i = 0, except that, for simplicity, we did not allow server one to 
help server two. It is clear that if p\ is big enough, then the large deviation 
when the first queue gets big is a bridge. 

Unfortunately, we have not been able to derive the asymptotics of the 
steady state probability of this system from the results in [4]. In the special 
case where pi* = p\ = pi + P 2 (where pq = p \ p .2 in the notation of [4]), 
formula (6.4) in [4] should give the asymptotics, but it is not clear how. 
In the general case when pq / P 1 P 2 , (7.2) in [4] gives a formula for G(z), 
which is essentially the z-transform of 7r(x,0). Again, we could not invert 
this function. 

We did not have better luck with [12], which is a special case of [4] with 
Ai = A 2 = A, pi = P 2 = p/2 and p* = p 2 = p. In this, the total number of 
customers in the system is exactly an M/M/1 queue with load p = (Ai + 
^ 2 )/{pi + P 2 ), where the probability the total number of customers is l 
decays like p £ . 

Fortunately the analysis in [6] gives the asymptotics of n (£,y) for the 
bathroom problem (as it was described in [22]) where couples arrive at a 
cinema according to a Poisson process with rate v and immediately visit the 
ladies’ and men’s room. The service rate, at the men’s queue is a, while the 
rate at the ladies’ queue is (3. This model was extended in [14] by allowing 
separate arrival streams with rate p for single ladies and rate A for single 
men. We are interested in a large deviation of the men’s queue, so let this 
be the first queue and the ladies’ queue the second. In the (unrealistic) 
case a < (3, the exact asymptotics of it(£, y) are given in [14]. Omitting the 
streams of singles (so A = p = 0), 


n{£,y) 


f 


a — u \a 


a 


‘-in?)’ 


where / is a constant. This is the positive recurrent case and the asymptotics 
are the same as (7.19) in [6]. 
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The theory in [14] could not handle the (more realistic) case a> (3 (note 
7 in [14] equals a since A = 7 = 0). The only result given was that at the 
stopping time ti when the men’s queue reaches size £, the ladies’ queue 
divided by £ converges to (a — (3)/(a — is ). However, the results of this paper 
do solve this problem because (3 < a gives the 1-transient case. Note that 
(44), (45), (46) become 

(54) e\ > 0 , 

(55) = 0, 

(56) ise 6 ie 0 2 + (3e~^ + ae~ 6 * = (is + (3 + a). 

Solving (55) gives 

(57) exp ( 6 * 2 ) = \/^Vex p(-^/2), 
substituting into (56), and letting z = exp(0j), we get 

(58) Af3isz 3 = ((a + (3 + v)z — a) 2 . 

We recognize this as equation Di(z) = 0 given at (3.2) in [ 6 ] (where is = 1). 

To make the connection to [ 6 ] (since they only consider the case a < (3), 
we must exchange the labels of the first and second queues so our a becomes 
/3 and vice versa in [ 6 ]. This converts the equation D\(z) = 0 into T> 2 (~) = 0 
and according to [ 6 ], there is only one solution z = a ' 3 with z > 1 , so 03 = 
exp( 6 1 ]'). The asymptotics of tt(£,u) are now given by those p y 7 in (7.20) in 
[ 6 ]. We immediately recognize the asymptotics £~ 3 ^ 2 (a' 3 )^ e for the additive 
component as was predicted by expression (47). 

Next by (57), exp( 6 »^) = s/fjv(a' z y l/2 , 

u = po = p = is exp( 61 ) exp(9%) = (3 exp(— 9%), s = aexp(— 6 \), 

so = a exp (—# 1 ) + /3 so k= 1— po~ so = /3 exp(— 9%) — (3 > 0 . 

Hence, the asymptotic distribution of the second queue is given by expression 
(47): 

exp(-«^(l + ^)=W / 2 (l+ (l-y«r 1/2 )#), 

and this agrees with (7.20) in [ 6 ]. Of course, [ 6 ] is much more precise since 
the constant term is given as well. 

There is still the null recurrent case to consider. Now k = 0 when ise e + 
ae^ 9 i + (3 = 1; that is, when f3e ~ e 2 = (3. Hence, 9\ = 0, so exp(0j) = f3/v, and 
this implies a = [3 when one considers exp(0j) = a ' 3 solves D 2 (z) = 0 in [ 6 ]. 
Hence, Proposition 1 gives the asymptotics £~ l ^ 2 ([3/isy l for the additive 




BRIDGES AND NETWORKS 


45 


component, and this agrees with (7.3) in [ 6 ] (since a = j3). Since (p(y ) = 1 in 
the null recurrent case and since 9^ = 0 , we conclude 



and this agrees with (7.3) in [ 6 ]. 

Of course, we still have to check the conditions A0-A7 and B1-B4, but 
these are essentially the same as for the modified Jackson network. Even 
the proof that B 1 holds is essentially the same because now we have jumps 
going northeast, but not southeast or northwest. Condition B4 holds because 
7r(0,y) < (1 - v / P){v / f3) y , so using (57), 


^7r(0,y)e e 2 y < 


y =o 


OO 

E 

y =o 


1 - 



< oo. 


Finally, let us say a word about the matrix-geometric method. The level 
is the additive component and the phase is the Markovian component of 
a Markov additive process with kernel K°°. For a QBD process, the addi¬ 
tive component is nearest neighbor. Denote the transition probabilities from 
phase i at level l to phase j at level l — 1, respectively, i and t + 1 by A, 
respectively, B and C. Hence, we can represent the Feynman-Kac kernel as 

= ^2e yt K((i,0)-,(j,t)) = (u^A + B + uC)^ 

t 


if v = exp(y). Solving the Riccatti equation associated with the matrix- 
geometric method is equivalent to finding a Perron-Frobenius eigenvector of 
the Feynman-Kac kernel with eigenvalue one. That means solving (z/ -1 A + 
B + vC)y = y is equivalent to finding 7 and h = y so K^h = h. Equivalently, 
the solution to the Riccatti equation gives a harmonic function h(x,i ) = 
exp( 7 x)/i(z) for K°°. 
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